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The  linear  time  invariant  aspects  of  the  least 
squares  theory  is  extended  in  this  paper  to  linear 
time  invariant  systems  with  performance  measures  of 
the  form 


dt;  L(x)  5 0; 


where  L is  a polynomial  in  the  components  of  x. 
Those  L*s  which  have  optimal  control  laws  which  are 
linear  are  characterized,  and  the  inverse  problem, 
i.e.  the  characterization  of  those  controllers 
which  are  optimal  relative  to  a performance  measure 
of  this  type  is  also  solved.  Our  basic  tools  in 
studying  this  problem  are  a new  lemma  on  the  path 
independence  of  certain  integrals  which  generalizes 
the  earlier  result  on  quadratic  forms  and  a 
positivity  condition  investigated  earlier  by 
Jacques  Willems  and  the  author. 


1.  Introduction 

R.E.  Kalman’s  1963  paper  [I]  characterizing, 
for  linear  stationary  systems,  those  linear  control 
laws  which  minimize  time  independent  nonnegative 
quadratic  performance  measures  on  an  Infinite  time 
Interval,  attracted  considerable  attention  because 
the  conditions  were  given  in  terms  of  the  Nyquist 
locus  and  confirmed,  to  some  extent,  engineering 
practice.  The  original  paper  discussed  the  scalar 
input  problem  but  It  was  shown  subsequently  that 
the  multivariable  problem  is  essentially  the  same. 
Other  papers  in  this  vein  have  appeared  subsequently 
but  always  staying  within  the  linear-quadratic 
framewo  rk. 

In  this  paper  we  work  out  the  corresponding 
theory  for  linear  systems 

x(t)  = Ax(t)  + bu(t)  (1) 

with  performance  measures  of  the  rather  more  general 
form  _ 


-r 
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L(x)  + L E 
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where  P denotes  the  set  of  polynomials  which  are 
nonnegative  for  all  real  arguments  and  vanish  when 
all  arguments  do.  As  might  be  expected  this  theory 
leads  to  different  conclusions  regarding  optimality, 
in  general  relaxing  the  conditions  found  for  the 
quadratic  case.  Somewhat  surprisingly  we  find 
that  the  L’s  which  yield  linear  optimal  control 
laws  are  necessarily  homogeneous  of  degree  2r. 

Even  among  these,  however,  linear  optimal  control 
laws  are  the  exception  and  not  the  rule  provided 
r exceeds  one. 

A particular  feature  of  Kalman’s  original 
result  was  that  it  was  stated  in  such  a way  as  to 
imply,  together  with  the  circle  criterion,  a 
strong  stability  property  with  respect  to  time 
varying  and  nonlinear  gains.  We  find  that  even  in 
our  more  general  context  this  feati^e  is  preserved. 

In  this  paper  we  use  for  the  most  part,  the 
notation  D « d/dt  and  write  (1) , (2)  in  higher 
order  form  as 


p(D)y  * u 


= f L(y.> 


(n-l).  . 2rj 
. .y  ) + u dt ; 


In  the  last  section  we  make  the  connection  with  the 
first  order  vector  differential  equation  notation. 

2.  Path  Independence 

In  our  earlier  work  {2-6]  we  showed  that  the 
connection  between  frequency  domain  conditions  and 
the  exlstance  of  quadratic  Liapunov  functions  and 
the  connection  between  frequency  domain  conditions 
and  quadratic  optimality  could  be  made  using  a 
lemma  about  the  Independence  of  path  of  integrals 
of  the  form 


^ a 


This  lenina,  which  we  will  generalize  below,  enables 
one  to  avoid  the  use  of  Fourier  transforms  and 
nanipulatlons  of  the  Kalitian-Yacubovic-Popov  type  In 
treating  these  problems.  Moreover,  using  this 
approach  we  were  In  [5],  able  to  bring  the  fre- 
quency domain  theory  to  a new  level  of  completion 
by  avoiding  positive  definiteness  conditions  and 
hence  allowing  one  to  establish  for  the  first  time, 
frequency  domain  instability  conditions.  In  this 


paper  we  take  advantage  of  the  Intrinsic  simplicity 
of  this  approach  in  using  it  as  a point  of  depar- 
ture to  develop  the  theory  of  higher  order  problems 
of  the  form  (3),  (^>). 


The  lemma  of  this  section  depends  on  certain 
elementary  facts  about  the  group  of  all  permutations 
of  a finite  set  of  n symbols  — the  symmetric  group 
on  n letters,  S(n).  Of  course  S(n)  has  n!  elements; 
we  denote  a typical  element  by  n.  If  we  have  an 
rth  degree  form  in  the  variables  x,  ,x. we 
can  represent  it  by 


f = I 

(a,b, . . .c)el(n,r) 


> , A A 

a,b, . ..c  a 


(6) 


where  I(n,r)  * {(a,b, . . . ,c) : 0^a^n,  O^b^n, . . .O^c^n; 

r ternis}.  But  such  a representation  Is  not  unique 
unless  we  synmetrlze*  (This  is  a generalization  of 
the  symmetrizatlon  of  the  matrices  representing 
quadratic  forms.)  A little  thought  will  convince 
the  reader  that  f may  also  be  expressed  as 


(1) 


h - v(x,x 

! »i‘b.  ■x<'>r 

(a,b, . . .c)el(n-l,r)  ’ * *a 

(11) 

with  the  B's  being  synonetrized . This  being  the 
case,  the  derivative  of  n — the  integrand  of  the 
original  expression  for  r\  — is  just 


n - I 

(a,b, . . .c)el(n-l,r) 


(c+1) 


) (12) 


hence  if  we  form  h using  this  expression  we  see 
that 

h(s,  .Sj, . • .s  ) = I 

(a,b, . . .c)el(n-l,r) 

^,b,...c<=l^V----^r)(«l4---^>  (13) 


f 


I 

.TCS(n) 


(a,b. 


I 

.c)el(n,r) 


“iT(a),Ti(b),...,Ti(c)’‘a*b---*c 

In  such  a representation  the  a's  corresponding  to 
a specific  (unordered)  collection  of  subscripts  on 
the  x’s  are  symmetric  in  that  the  interchange  of 
two  subscripts  in  ^ does  not  change  its 


In  what  follows  we  use  to  denote  the  ith 

derivative  of  the  function  x : TK  ^ • 

Lemma  1 : If  x : ■»?!  1 is  t.  times  differen- 

tiable then  the  Integral 


fb 

I « K 

‘a  (a,b, . . .c)El(n,r) 


r factors 


(8) 


is  expressible  in  terms  of  x{a),  x (a),...x  ” (a) 

and  x(b)  , xd)  (b)  , . . .x("'l)  (b)  if  and  only  if  the 
polynomial  in  the  Indeterminates  Sj^,S2,>..s^ 


h(a, ,s, , . . .s  ) 


4 I 

n ! V 


I 


TCS(n)  (a,b , . . .c)cl(n, r) 
n a b c 

“Ti(a),Tr(b),...7T{c)®l®2--'®r 


(9) 


can  be  factored  as  h(Sj^,S2, . ..s  )»(Sj+S2+. . .s  )x 
' ’®r^  with  ffl  a polynomial.  ^ 

Proof*  Without  loss  of  generality  we  may  suppose 
that  the  coefficients  a have  been  symmetrized  via 
(7).  This  does  not  change  the  value  of  the  Integral 
and  means  that  we  can  express  h more  singly  as 


hCsj^jS^*  • • ♦ »®j*) 

* I 

(a,b, . . .c)el(n,r) 


a,b, . . .c  1 2 


(10) 


Now  suppose  that  the  Integral  is  Independent  of 
path  in  the  above  sense  and  that 


Hence  the  indicated  factorization  of  h is  a 
necessary  condition. 

To  establish  sufficiency,  suppose  that  we 
write  h(s2,S2, . . .s^)  = (s,+S2‘*'-  • •Sj.)m(s2 ,82 . . . -s^) 
with  m given  in  symmetric  form  by 

m(s,  ,S2,. . .s  ) « 51 

(a,b,...c)el(n-l,r) 


a,b,. 


a b 
s,s,. 
, .c  1 2 


Form  the  function 


c 

s 

r 


(14) 


I 

(a,  b , . . .c)el(n-l ,r) 


Y . X 

a,b,.  . .c 


(a)„(b) 


.x(=> 

(15) 


It  follows  by  differentiation  (as  used  above)  that 
the  derivative  of  n is  actually  equal  to  the 
integrand  and  so  n • n(a)-n(b)  and  the  proof  is 
complete . 


The  operation  of  passing  from  the  form  to  the 
symmetric  function  hCs^^.s^*  • . *8^)  establishes  a 
one  to  one  correspondence  between  homogeneous  forms 
of  degree  r in  x,x(J^) , . . .x^*')  and  symmetric  poly- 
nomials in  This  operation  is  vaguely 

analogous  to  the  assignment  of  a symbol  to  an 
operator  in  partial  differential  equations  and  we 
will  call  h the  symbol  of  the  form. 

Notice  that  in  the  case  where  p * 2 there  is  a 
particular  simplification  which  occurs  in  the  path 
independence  condition.  In  this  case  we  have  in- 
dependence if 

h(s2,82)  ” I “ab®l®2  ’ (Si''^2^”(®l’®2^  (3^) 


however  h(s^ ,S2)contain8  *^‘*.*2  “ ® factor 
If  and  only  If  h vanishes  upon  setting  s ■-82. 
Thus  we  see  that 


hfs^.-s,)  - 0 (17) 

Is  equivalent  to  the  condition  which  appears  In  [4] 
and  [6],  (Incidentally  there  are  minor  defects  in 
all  the  previously  published  proofs  of  the  p*2  case 
that  I know  of.  The  present  proof  plan  may  be  the 
best  way  to  proceed  even  if  the  case  p»2  is  the 
only  one  of  interest.) 
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3.  Sufficient  Conditions  for  Optimality 


4.  The  Main  Theorems 


As  is  made  clear  in  [6],  all  of  the  conven- 
tional least  squares  theory  can  be  derived  from 
the  inequality  for  real  n-vectors  <x,x>  > 0 via 
completing  the  square.  In  the  present  setting  a 
key  role  is  played  by  the  inequality  in  real 
variables  a,  b 

0 s:  a^'^+2rab^’^"^+(2r-l)b^'^ 

/ 2r-2  „ 2r-3,  2r-4.2  ...  2r-2, 

= (a+b)  (a  -2a  b+3a  b - . . .+(2r-l)b  > 

(18) 

This  result  is  easily  verified  by  differentiating 
with  respect  to  a and  seeing  that  2ero  is  the  mini- 
mum value.  Moreover  a = -b  is  the  only  condition 
under  which  the  inequality  is  not  strict. 


The  above  observation,  together  with  lemma  1 
allows  us  to  state  what  looks  a priori  to  be  a 
rather  special  sufficient  condition  for 
u=-q(D)y  to  be  an  optimal  control  for  (3),  (4).  In 
actual  fact  this  condition  turns  out  to  be  much 
more  general  than  it  appears.  Here  and  below  we 
call  a control  law  stabilizing  of  it  makes  the  null 
solution  asymptotically  stable  in  the  large. 


Lemma  2 : Let  u and  y be  related  by  (3).  A suf- 
ficient condition  for  a stabilizing  control  law 
u * -q(D)y  to  be  optimal  relative  to  all  other 
(linear  or  nonlinear)  stabilizing  control  laws  is 
that 


L(y.y 


(1) 


= (2r-l)(q(D)y)^’''^(p(D)y- 


— Dq(D)y) 

Vl 


+2r(q(D)y)^^+E  (19) 


We  now  characterize  those  L*s  which  have 
optimal  control  laws  which  are  linear  and  at  the 
same  time  set  the  stage  for  the  solution  of  the 
inverse  problem. 


Theorem  1;  The  linear  dynamics  (3)  and  the  perfor- 
mance measure  (4)  give  rise  to  an  optimal  stabiliz- 
ing control  law  which  is  linear  if  and  only  if  L 
is  homogeneous  of  degree  2r  and 

L(y.y^^>....y^"-^^ 

= (2r)(q(D)y)^''-(2r-l)p(D)y(q(D)y)^'''L/‘ 

(22) 


for  some  polynomial  q(D)*(q  ^4q  ^+...+q  ) 

r \ n—  i n— z o 

and  some  <^'“r^(y,y  ,...,y(^”^))  such  that 

p(D)+q(D)  has  all  its  zeros  in  Re  s < 0, 


Proof;  We  have  already  seen  in  Lemma  2 that  this 
condition  is  sufficient  for  optimality.  We 
establish  its  necessity  here. 


Suppose  that  there  is  an  optimal  stabilizing 
control  law  u(t)  = h(D)y(t).  Then  since  L is  a 
polynomial,  the  minimum  value  of  n corresponding 
to  an  initial  value  of  y,  yd) , . . . ,y(^'"l)  will  be 
a polynomial  in  these  variables.  (This  was  worked 
out  in  Liapunov’s  thesisl)  Call  this  polynomial 
(J).  By  computing  the  derivative  of  (J*  along  solu- 
tions of  p(D)y  = -h(D)y  we  get 

T -L(y.y^')....y(''-lV(h(D)y)'^ 

i=0  (23) 

provided  we  set 

y^"^  = -(p^_^y^"’^^+...+P^y)-(h(D)y)  (24) 


where  E *=  E(y,y . .y^"^  ^^)  satisfies  the  condi- 
tion of  lemma  1. 

Proof;  We  write  using  the  hypothesis 

n = f L(y,y^^\...y^"'^^  + (p(D)y)^''dt 


0 


Moreover,  and  it  is  surprising  how  much  this  point 
reveals,  if  we  exchange  h(D^y  for  0(h(D)y  in  these 
equations  and  replace  (J>  by  0(Qt>y  »y  ^ . .y  ) 
it  follows  from  the  optimality  of  h(D)y  that 


(2S) 


(2r-l)(q(D)y)^'^'^(p(D)y-  Dq(D)y) 

J A 


+2r(q(D)y)^'^'t-(p(D)yf 


n-1 

r 


(p(D)y+q(D)y)^ij((y  .y^'^L  . . 

1 2r-l  , ,2 

'T  :~Tr 

r>-l 


dt  + E 

this  new 

new  ve  rs 

0 

1 

c 

8 

n-2  ~ 

Y -Jii. 

i ( 

1-0  By' 

+ E (20) 

A ' A 

+ 

We  use  this  fact  as  follows.  In  (23)  and  (24) 
replace  h(D)  by  ah(D)  and  replace  by  Then  use 


(i+1) 


(i) 


5y 


2r, 


.(1) 


where  ip  in  the  last  Integral  Is  given  by 
,,  (1)  (n-1),  , .2r-2 

'Ky.y  . . • -y  ) * (p(Wy) 

-2(p(D)y)^''"^(q(D)y)  + ...+(2r-l)(q(D)y)^’'‘^ 

(21) 

and  is  nonnegative  In  view  of  the  first  inequality 
of  this  section.  This  representation  makes  it  clear 
that  the  way  to  minimize  n Is  to  let  p(D) y+q (D)y-O 
because  E('")  and  E(0)  are  fixed  by  the  Initial  data 
and  the  stabilizing  assumption. 


-a^’^(h(D)y)^‘'  (26) 

Let  indicate  the  derivative  of  (i  with  respect  to 
a.  Then 


n-2 

I 


(i+i) 


1*0  By 


(1) 


By 


(n-1)  '^Pn-1 


y^"''L...P„y) 


4oi^'^(h(D)y)l-2ra^'''^  ■.(h(D)y) 

- -2ra^''"l(h(D)y)^'’  (27) 
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In  order  for  to  vanish  at  a = 1 it  is  clear 
that  the  last  term  on  the  left  must  equal  the  term 
on  the  right.  But  at  a * 1 ^ equals  (p  so  we  obtain 
the  key  equation 

2r  — Ifliy  h(D)y  = 2r(h(D)y)^''  (28) 

3y' 

The  first  consequence  we  draw  from  (28)  is 
that  since  0 ^ ifi  cannot  depend  linearly  on  y(n-l) 
it  must  satisfy 

$ = 6(h(D)y)^''-h))^(y,y^^\...y^"'^^  (29) 

where  6 = with  the  coefficient  of  ^ 

in  h(D)  (necessarily  nonzero). 


Using  our  new  representations  for  (Ji  in  (23)  we 

set 

I — ^ y^^'^^^+2rg(h(D)y)^''"^Dh(D)y) 
i-0  3y'^'  , , , 

= -L(y,y^^\...y^''~^0-(h(D)y)^’^  (30) 

with  the  understanding  that  the  h ly^"^  terms  which 
appears  in  the  second  term  on  the  left  must  be 
eliminated  using  (24).  This  is  conveniently  done 
by  subtracting h^_ j(p(D)y+h(D)y  from  Ilh(D)y  yielding 

2r(h(D)y)^’^”^(h(D)y+p(D)y) 

= -L(y,y^^\...y^'’‘^^-(h(D)y)^''+^  (31) 

where 

E (<P  +?(h(D)y)^'')  (32) 

at  o 


Tills  then  yields  the  equation  of  the  theorem  state- 
ment if  we  let  q(D)  * h(Dl . 

We  still  must  establish  that  L is  homogeneous 
of  degree  2r.  This  Is  actually  a consequence  of 
Che  nonnegativity  of  L In  the  following  way.  Let 
L^5  be  either  the  collection  of  highest  degree  terms 
In  L or  the  collection  of  lowest  degree  terms  in  L, 
If  Its  degree  is  not  2r  then  by  (24)  we  see  that 
does  not  depend  on  y(n-l)  hence  is  exact  in 

the  sense  of  lenma  1.  Since  it  is  exact  the  high- 
est derivative  of  y present  enters  linearly  and 
since  is  of  extreme  degree  in  L (either  the 
highest  or  the  lowest)  this  is  incompatible  with 
L i 0.  Hence  must  be  of  degree  2r. 

Theorem  2;  Given  the  linear  system  (3)  there  exists 
an  L in  P”*"  such  that  u • -q(D)y  is  optimal  for  (4) 
among  all  stabilizing  control  laws  if  and  only  if 

[ [p(D)y+(-^-^)q(D)y]  (q(D)y  ]^'’'’^dt 

•'a  ,b  * 

- (Ji(x)  + i(<(x)dt  (33) 

la  J a 


sufficient  condition  is  developed  (see  theorems  4 
and  5 of  Part  II).  The  basic  idea  is,  of  course, 
that  the  system 

P(D)y+  q(D)y  - u;  y(t)  - ^ 

should  be  "passive"  or  "positive"  in  a special  and 
Strong  way,  namely,  in  a way  that  is  revealed  by 
polynomial  (p  and  functions. 


If  we  give  up  the  requirement  on  L that  it  be 
polynomial,  then  the  class  of  linear  control  laws 
which  are  optimal  becomes  wider  still.  The  reason 
for  this  is  that  it  is  best  understood  in  the 
context  of  this  theorem  and  may  be  explained  by 
saying  that  there  are  positive  systems  which  are 
not  polynomlally  positive.  This  is  brought  out 
forcefully  by  the  results  of  O’Shea  [8].  In  view 
of  this  one  may  also  state  a related  result. 


Theorem  3:  Given  the  linear  system  (3)  there 
exists  a nonnegative  function  L such  that  for  (3), 
(4)  the  control  law  u = -q(D)x  is  optimal  among  all 
Stabilizing  control  laws  provided 


for  all  paths  y of  compact  support  and  p(D)+q(D) 
has  all  its  zeros  in  Re  s < 0. 


One  connection  with  Fourier  methods  should  be 
pointed  out„  One  sees  easily  (for  example  by 
letting  y(t)=sin  cot)  that  a necessary  condition 
for  the  hypothesis  of  theorems  2 or  3 hold  is  that 

Re(p(iu))+  q (ico) )q (-ico)  i 0 (35) 


as  a consequence  the  Nyquist  locus  of  the  system 
r(s)  * q(s)/p(s)  satisfies 

Re(l+(^)g(s)]g(-s)|  SO  (36) 

which  means  g(ico)  must  avoid  a circle  centered  on 
the  negative  real  axis  having  a diameter  the 

segment  [-  2fli*  figure  1 where  the  disks 

for  r»l  and  are  sketched. 


with  (p  in  and  all  zeros  of  p(D)+q(D)  In  Re  s < 0, 

Prop f ; Suppose  such  a decomposition  exists.  Let 
L«tj)  and  apply  the  inequality  of  lemma  2.  On  the 
other  hand,  suppose  that  -q(D)x  ■ u is  optimal. 

Then  applying  theorem  I we  see  that  we  can  take 
to  be  L(y,y, . . .y(^~l^)  and  0 to  be  “E. 


It  is,  however,  to  be  emphasized  that  for  r>l 
this  Nyqulst-llke  condition  is  only  a necessary 
condition  for  optimality.  Theorem  2 must  be 
checked  if  the  Nyquist  locus  passes  into  the  r*l 
disk  but  not  into  the  r*®  disk. 

5.  Stability 


Remark:  Note  that  0(x)  is  necessarily  nonnegative. 
In  Brockett  and  Willems  [3]  the  conditions  under 
which  a decomposition  of  the  type  called  for  here 
are  investigated  extensively  and  a quite  general 


As  a direct  result  of  the  inequality  of 
Theorem  2 we  can  establish  the  following  stability 
property  of  optimal  systems.  The  special  case  r*l 
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Is  well  known. 


Theorem  4:  If  u-  -(q(D)y)  is  an  optimal  stabiliz- 
ing control  law  for  system  (3)  and  performance 
measure  (A)  then  the  null  solution  of  the  closed 
loop  system  obtained  by  setting  u(t)«  -k( t)q { D)y ( t ) 
will  be  stable  for  all  k such  that 


^ k(t)  < » (37) 

Proof : The  closed  loop  equations  are 

p(D)y(C)+k(t)q(D)y(c)  - 0 (38) 

multiply  this  equation  by  (q(D)y)^*^  ^ and  rearrange 
it  as 


{q(D)y)^'''Mp(D)y+(^)q(D)yl 

= -(k-  •^)(q(D)y)^''  (39) 

using  theorem  2 we  see  chat 

^ <(1  • -i^(k-  ^)(q(D)y)^  (40) 

Thus  4)  is  a Liapunov  function  whose  derivative  is 
negative  semidefinite  provided  the  hypothesis  holds. 


6.  An  Example 


To  illustrate  some  of  these  ideas  we  consider 
the  second  order  system 

y = u;  n * I L(y,y)+u^’^dt  (41) 

*'0 

According  to  theorem  1 we  must  have  for  linear 
optimality 

L(y,y)  = 2r(ay+Sy)^’^-(2r-l)(ay+By)^'^”^(^)y+Yyy^'^”^ 

“ (42) 

because  an  exact  form  is  of  the  type  yyy^^  To 
find  out  if  L is  nonnegative  we  introduce  y/y*2. 

The  condition  for  nonnegativity  is  then 

2r(az->-B)^'^-  z (az+B ) ^ ^-hyz  i 0.  (43) 


A lengthy  calculation  shows  that  this  is  nonnegative 
for  some  y if  and  only  if  the  obvious  necessary 
condition  holds  on  the  highest  power  of  z, 


2r  (2r-l)B  2r-l  . « ,, ,, 

2ra  - ^ a ^0  (44) 

This  is  equivalent  to 

a^/B  > (45) 

Notice  that  for  r=l  optimal  systems  have  damping 
constant  larger  than  .7071  but  for  r = ■»  it  need 
only  be  larger  than  1/2. 


7.  The  Rlccatl-Llke  Formulation 

For  the  sake  of  completeness  we  give  here  the 
"state  space"  version  of  the  main  conclusions.  To 
begin  with  we  remind  the  reader  of  some  notation 
which  will  play  a role  here  as  it  has  in  some  other 
recent  work  in  system  theory.  If  x is  an  n-tuple, 
(x.  ,x.,...,x  ) then  by  xl^'J  we  mean  the  ("■*'f“l)- 
tuple'^  " 


.If] 


1 

r-1 


r-1 

^2^1  ^3 


(46) 


where  the  are  chosen  in  such  a way  as  to  have 


<xW.xl-^n 


i2r 


If  y * Ax  then  there  exists  A 
y‘-^LAtr],(r 
that 


[r] 


such  that 


If  X = Ax  there  exists  A,  , such 

[r] 


dt  * 


(47) 


See  our  earlier  papers  [9,10]  for  some  properties 
of  "super-[r]"  and  "sub-(r]"  and  some  control 
theoretic  applications. 


Here  we  are  especially  concerned  with  quad- 
ratic forms  in  It  is  clear  that  for  each 

symmetric  matrix  Q (we  write  ^y  for  transpose) 


0(x) 


t 

X 


(48) 


is  a form  homogeneous  of  degree  2r.  If  r and  di 
exceed  1 there  are  nonzero  synmetric  Q*s  such  that 

= 0 so  we  see  that  the  representations 
of  4)  in  this  way  is  not  unique.  However  the  non- 
uniqueness  is  easily  described.  If  and  Q2 
define  the  same  homogeneous  form  then  Qj^“Q2  is 
equivalent  to  zero.  Thus  we  see  that  given  n and 
r there  is  a subspace,  K(a,r),  of  the  space  of  all 

/H+r-lv  , . , , 

symmetric  ( )-order  matrices  such  that  any  two 

such  matrices  define  the  same  homogeneous  form 
if  and  only  if  their  difference  is  in  K(n,r). 


The  following  lemma  should  be  borne  in  mind 
when  interpreting  the  equations  which  follow. 


Lemma  1 ; The  space  K(n,r)  is  invariant  for  oper- 
ators of  the  form 

L(Q)  = ]■*■''* [r)'^ 

Moreover  there  exists  a conplementary  space  which 
is  also  invariant. 

Proof:  If  4>(x)  * then  along  solutions 

of  X * Ax  we  see  that 


31 


•xI'W."' 


(50) 


but  if  Q is  in  K(n,r)  t)ien  the  derivative  is 
clearly  zero  and  hence  L(C))  is  in  K(n,r). 


If  we  regard  the  space  of  syimnetric  matrices 
of  order  (n+r-l)  as  an  inner  produce  space  with 
<M,N^tr  M^N^then  it  makes  sense  to  ask  if  the 
orthogonal  complement  of  K(n,r)  is  also  Invariant. 
To  see  that  it  is,  let  K belong  to  K(n,r).  Then 
for  all  Q 

trlK(*'Aj^jQ+QAj^j)l-trt3(lfAj^j+A|^jK)l  - 0 (51) 

this  last  fact  coming  from  the  fact  that  *Aj^j 
- ('^A)|^j.  (See  110].) 


Now  consider  the  linear  system  (1)  with  the 
performance  measure 

P t [^'1. 

n * X Mx  +u  dt  (52) 

Jo 

In  terms  of  this  notation  equation  (23)  becomes 
Q(A+bc)  [^j+'^(A+bc)  j^jQ  = (53) 

and  (28)  becomes 

Q(bc)  j^^+''(bc)  (5A) 

In  the  case  r=l  this  pair  of  equations  specializes 
to  the  familiar  pair  from  least  squares  theory, 

QA+'^AvhQb'^bQ  = -M;  Qb  = (55) 

Assuming  controllability  of  (A,b),  according 
to  theorem  1 these  equations  have  a solution  (Q,c) 
if  and  only  if  for  some  ^c  G with  cb  9^  0 we 
have 

^x^'^^Mx^*^^=2r(cx)^^-(cb)  ^(2r-l)  (cx)^'^  ^(cAx)+E 

(56) 

where  E * E(y ,y^^\  . . . .y^*^  ^^)  is  a perfect  differ- 
ential* That  is 


E = ''x^'^’(RAj^j  + ''Aj^^R)xf''l  (57) 

for  some  R = having  the  property  that  for  all 
in  -gf 

F(d)  = R(bd)j|^j  + ‘(bd)ji^jR  = 0 (58) 

(Tills  last  condition  insures  that  E does  not  depend 


The  verification  of  these  remarks  is  left  to 
the  reader. 
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